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Long-Term' Effects 1 

» 

Long-term Academic Effect^ of Oirect Instruction Follow Through 

It has been fifteen years since the Follow Thrdugh program 
of enhanced instruction in early childhood education was* 
introduced for grades kindergarten through three in elementary 
schools serving disadvantaged children in 180 communities 
throughout the United States. 1 , Children who were N in the first 
cohort of Follow Through classes are now about twenty years old — 
old enough to be ( sophomores in college, high school and junior * 
high i school^ dropouts ^ shopclerks or shop mechanics . This- means 
that we' now have our- first "opportunity to measure the long-term 
effects of Follow Through instruction through several of the most 
important career-branching points in .a young "person's life. Did 

'they finish school or drop out? Did' they apply to and enter 

* ■ * 

college? How was their academic performance in high school? In 

short,' we now have^an opportunity to test Follow Through as a 

long-term social and educational investment, to, see whether it 

has paid off, and to suggeac implications for early childhood and 

other educational programs . . The primary research question was 

how the Follow Through graduates compared* through high school 

with a control group. Of secondary interest was how the Follow 

Through students' third grade performance correlated with their, 

ninth grade performance in reading and math.* * y 

In this paper I shall compare the long-term perf ormance K of 

the first three cohorts of Follow Through children fi^m P.S. 137, 

the Bainbridge School, in Brooklyn's Ocean Hill - Brownsville 
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section, with a control group of n&p-Follow Through children frofe 

a school in the same area just a few blocks away. There are just 
( '/ ' 

. a few longitudinal • studies . #f . disadvantaged children who have 
' ' ' ■ 

been in early childhood programs The results of these 

investigations are reported next, though none ofi the studies 

'reports'on the high school per/ormance of the*e3rly childhood 

program graduates. 

Hunt (1982) synthesized almost *a hundred studies qn 

developmental theory ^nd^early childhood interventions thtft 

resulted in higher performance for predictably low-perf oirming 

children. He declared, "The fiction that psychological 

development has a fixed rate predetermined by 'heredity is hard to 

reconcile with the findings," (Hunt, 1982, p. 5). Hunt's 

research focuses on intervening with infants at birth, and their 

mothers, or foundlings such as* children "in th£ Tehran Orphanage 

and their caregivers. In all of these settings, Hunt's 

intervention strategies produced demonstrable differences 

favoring the experimental children — those children receiving. 

instruction. These studies strongly suggest that early 

intervention will benefit infants and young children in high risk 

e 

situations — those children most likely later to fail in school. 

Lazar, Hubbel, Murray, Rosche, and Royce (1977) and then 
Darlington (1981) studied fourteen infant arid preschool 
experimental programs to search for common effects from early 
childhood programs. They report generally positive treatment. 
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effects, with fewer experimental students placed /inter Special 
Education classes. Ohiy 8.6% of -the experimental students, in 
contrast to an average of 29% of the control students , required 
special education placement. This report, most "bf ten referred to 
as "The Consortium," also found significant dif f eretices in 
tetention. Twenty-four percent Vf the control students were 
retained, bu^ fewer than 19% of the experimental stuaents Vere 
held back. It is interesting "to note, though, that among the 
fourteen experimental groups with the highest retention' rate 
•"(almost 50%) also showed the lowest percentage of students later 
placed into^special education classes. Thus* these findings > 
suggest that program^ that, retain students a's a preventive 
measure — using the holdover time as an opportunity for the 
'students to catch up before they are promoted — may have long-term 
benefits. These findings may raise doubts about the validitiy of 
using retention as a me^ure of long-term effectiveness in early 
childhood programs^ since It appears that early retention may 
increase the chances that low-performing students will do well 
later in school.^ 

The Consortium studies also report IQ scores for the 
experimental and control students. The later effects of thes|> 
early childhood programs when IQ was measured immediately, and 
then again after one, two, three, and four years, show an average 
drop of about 4 more IQ points for the control st(iWents than tftfe. 

4. 

experimental students. The remaining data in these reports are 
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from student or paxental interviews dealing with topics such. as 
how individual student^JtMnk they*are doing in school, or 
whether the-parents feel the preschool program was good for their 
child. Therefore, these data are difficult to quantify and 
interpret . \ • * 

9 

Another report focuses on just one of the fourteen programs 
reported' by the Consortium. It is, Young Children Grow Up; The 
Effects of < .the Perry Preschool program on Youths Through Age 15 , 
by Schweinhart and ifeikart (I960). This book describes Weikart's 
Cognitive Curriculum which draws heavily from the teachings of 
Piaget, and. the long-term effec^ts^of this/^rogra*^ on young ' 
children. The major findings f $om Weikart 1 s laboratory wbrk in 
the Perry Preschool Program are: 

1. ?h£re was a difference of about 12 IQ points for the 

' *' ' * ^ , ji 

experimental and control groups at age 4 , but the differences in 
IQ disppeared and both groups had IQ f s. of about 81 at age. 14. 

2. Weikart's group showed more motivation and potential in 

* ■ ' \ 

elementary school. - , X 

3. The experimental group placed higher values'on schooling 
at age 15. .u 

4. Norm-referenced achievement test data, reported as 
percentages of items passed by each group bn the California 
Achievement Test (the CAT), show the experimental^ students 
outperformed the control group /54% to 47%) at age 8. At age 14, 
the experimental group dropped to 36% correct and the control 
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group to 28% items passed for Total Achievement, Reading 

performance has the experimental group at 62% and the control 
7 ' ; . • , 

* group at 56% at age $, but at 37% and 30% v respectively, at^ age 14, 

Math and language performance, are similar although the 

experimental group at age 14 outperforms the control "group 39% to 

29% items correct. ^ 

V . 5 v The p erry Preschool study also reports that "deviant 

s, * ■ 

.behavior" in school was less for the experimental group. The 

y k 

jk 

experimental group was more self-confident, although the 
" / 
% * differences were not great. 

The Consortium study and the Schweinha^t and Weikart work 

4 ended before the students finished high school. But, the drop in. 

IQ for the Schweinhairt and Weikart experimental subjects, and 

similar drops,.by the students in the Consortium group, show that 

ma^or differences between these *two groups have diminished by the 

t 

beginning of high school. With both of thes^e studies, the longer 
one traces effects, the'fewer differences there' are between the 
experimental aijd control groups. . I 

' ' (t • ■ 

This study extends the findings from the pr^vioo^y cited 
K studies of the long-term effects of earlyj childhood education 
programs and departs from those studies in 6ive v ways. Fi£St, it 
reports on students who had been in a very structured 
kindergarten through third grade early childhood program, Direct 

Instruction Follow Through, as developed by Engelmann and Becker 

*\ 43 / 

N in 1968. The other, longitudinal studies are of Miiuch more 

/ 
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traditional^ therefore, less academic and shorter term early 

•childhood programs Second ,^thl^jLs a study of the long-term 

•effects of a School-based intervention., Therefore, the results 

of this work have ecological validity and significance for ear^y 

* childhood education in school settings. ' Third, all data were 

collected in naturalistic settings, from .school records in 

regular schools in New York City, whereas the Schweinhart arid 

W^ikart students were in a laboratory program as were the ; 

Cpu^ortium Study students. Fourth, in this study, I followed 

Direct Instruction Follow' Through graduates and a control group 

through high school, thereby completing -the' measures of 

elementary and secondary school success. And, last but perhaps 

most important, this study focuses on general outcome measures of 

schooling — graduation and. college application, as well as upper 

grade reading and mat^h achievement. I agree with Maeroff ^1982) 

that "A diploma is no j longer a luxury; it is the key that opens 

the first lock on the door to the job market" (p. 47). 

In this .study, I trace the performance of Folldw Through 

graduates (children who had either three or four years 'in the 

Direct Instruction Program at P.S. 137) to see if there appear to 

be lasting effects in high school from their early childhood 

Follow Through program. P.S. 137 Follow Through graduates were 

selected for "this study because this school: (a) was the only one 

of the New' York City and Philadelphia inner-city Follow Through 

► 

sites to demonstrate significant student achievement gains and 
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positive affective outcomes (Stebbins, St. Pierre, Proper, 
Anderson,' \ Cerva, 1977; p. 150) at' the end of third grade; (b) 
has continued ,to demonstrate its effectiveness "in basic skills 
for over .a decade (Meyer, G^rsten, & Gu'tkin, J983) ; and , ( c ) is 
characteristic of inner-city - schools serving disadvantaged 
minority students. ^Therefore, a program of demonstrated long- 
-term effectiveness in this setting has implications for other 
inner-city elementary .schoo^. programs . 

As J shall detail later, P.s. 137 and the control school 
were fairly comparable in racial composition and very comparable 
in economic composition and reading achievement prior to the 
implementation of Follow Through in 1968. ' Both schools draw from 
very similar neighborhoods of multiple family row houses, 
abandoned buildings, vacant 1 lots, and corner stores. This area 
shows many signs of racial isolation and poverty. 
- v ' METHOD 

| Setting ' 

The two schools in this study are in District 23, the Ocean 
Hill-Brownsville section of Brooklyn. This area is well known 
for .being one of the most disadvantaged areas of the country (New 
York Times , February 4, 1980). .District 23 is one of the lowest- 
^performing of the 32 school districts in New York City* The 
fifteen elementary schools in the district average %igt\\ in rank 
out of the 630 elementary scliools in New York Gity . * 
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P.S. 137 is the only Direct Instruction Follow, Through' / 

school, in New York City. Thas, it was the obvious choice for . 

thi^ study. We Chose a second school in Disttict 23 that we 

believed to be demographically equivalent to P;s. 137 to serve as 

tne control school. . New Ydrk' City "Central Board of Education 

records going £ack* to 1968 revealed that the tw6 schools had' 

\ • * . 

similar pattetns of- reading achievement "(in 1966-1967)/ ethn^icitfy 
* * \ i ■« » » 

;(in 1969-1971 X, and socioeconomic status (in 1973). * Table 1 . 

I-'"-' > . • ' ' ' ) 

presents the comparisons for the tVo schools. In both schools, >' 



Students 'in second and third grajie entered these grades at \> A 
comparable levels (1.6 at< second grVde and 2.4 at tjiird- grade in 
rade equivalents) on the Metropolitan Achievement Test for the 
ears immediately preceding the implementation of Follow Through. 
Likewise, these students completed second and third- grade at 
comparable levels. (2.3 and 2.5 at the end of second ,grade; 3.2^ 
and 3.3, respectively at the en<f of third grade) during those 



y 



.« , • .A* •« «*. 
years. r " 



Insert °Table 1 about here. 



The two schools\ then had roughly equivalent Black and Puert^ 
Rican populations in\l969, 1970, and 1971-the first three !>ears 
of Follow Through... p\s. i37 averaged over r 85% Black students , 
(84%, 87.3%, and 89.3%)^, wheaeas the control school's Black , ' 
population was approximately 82% (82.2%, 80 .7%, ' 82 13%) for the 



/ 
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same three years. The Puerto Rican populations shifted during 
the 1969-1971 school years with a little over 11% (14.3%, 10.3%, 
9.2%) of the P.S. 137 children from Puerto Rican heritage,^ 
compared to about 17% (17.1%, 18.4%, 16.3%) from the control* 3 
school. * 

The 1973 percentages (in 1973 Cohort 2 Follow Through 

students were in third grade) from the two schools fbr families 

' - . ■ / 

receiving aid for dependent child ren (AFDC) were also very 
similar. Almost 77% (76.9%) of the P.S. 137 families received 
AFDC in 1973, compared 77.5% <>£ the^YanTnrfes from the control 
school. Thus, the AFDC percentages were still nearly Equivalent 
when the Cohort 2, Follow Through students were irt third grade. 
Therefore, we demonstrated that the two schools ' -»d comparable 
reading levels before Follow Through began and comparable ethnic 
mixes and percentages\of families^ receiving support for dependent 



children during the* implementation of Follow Through. 



\ 



Treatment 



The Direct Instruction Follow Through Model at P.S. 137 

attributed its results to: (1) sponsorship — the school worked M 

closely with Project Manager appointed by the ^niyersity of 

Oregon to transmit the Direct Instruction Model to the site; (2) 

the Distar (Engelmann & Stearns, 1972) curricula In/Yeading, 

language, and math with its emphasis on carefully sequenced 

, lessons, hi,g,h amounts of practice, and mastery; (3) increased 

allocated time to basic skills instruction — about 60 percent of 
J 

\ 

ERIC • ■ x * 
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» ■> 
the .school day i s spe nt on reading, language, and math; (4) , 
monitoring of criterion-referenced and norm-referenced student 
progress; and (5) teacher training i n workshop and classroom 
settings to focus on student performance (Meyer, et al . , 1983). 

At P.S. 137 , the Follow Through program begins in 
kindergarten, but students may also enter as first graders. 
Regardless of whether children begin the* program in kindergarten 
or first grade, they continue through three levels of the program 
(see Becker, 197.3. or Meyer, et al., .1983, for more thorough 
descriptions of the Direct Instruction model). Because of these 
two entry points and the model 1 s \efmphasis on acceleration based 
upon skill mastery, the highest-performing groups of children may 
finish 3II three levels of the r reading, - language, and math 
programs by the end of second grade. Low-performers, on the 
other hand, may not finish the third level programs by the end of 
third grade. Once groups finished the Direct Instruction 
programs, in second or third grade,, they went into the basal 
reading and math series adopted by the school. 

The students in the control school were in traditional 
classes that emphasised reading and math instruction starting in 
first grade /x 

Finding the St udents: . Procedures 

*■ — -.^ 

The Direct- Instruction jjjj^ Th^ou^h Students . The first 
step was to identify all children in the. f irT^s^QXld^ and third 
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cohorts (groups entering Follow Through in the 1968-1969, 1969- 
19 70, or 1970-1971) school years. In the spring of 1981, when 
the Cohort 1 students were seniors in high school, the Follow 

/ 

through Coordinator and I began to search the Follow Through 
records to make up rosters of the Cohort 1, 2, and 3 students. 
w e had to reconstruct the rosters since there had been no on- 
going contact with these students since they graduated from 
Fellow Through at the end of third grade. We then reduced the 
rosters to eliminate students who had not remained in the Follow 
Through program for either three or four years. This study is 
limited to three and four year students because we felt the 
^ruest test of the model's effectiveness would be with , students 
who had completed three levels of the program. We sought to 
follow three cohorts of students so that each "cohort ^could 

V 

< 

re Plicate the findings from the other cohorts, as suggested by 
Cook and Campbell (1979). 

The second step was to trace the Cohort 1, 2, and 3 students 
to their respective high schools. The procedures for tracing 
each cohort are slightly different, so we will report the 
procedures sequentially. We began tracing Cohort 1 anci 2 
students in the spring of 1981, working from the Follow Through 
records and the school records in the control school to find the 
transfer school for each child on our rosters. We searched the 
records by hand, recording the intermediate school the student 
reported that he/she planned to attend. 

14 
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Next, we organized and coded the lists of students by school 

and contacted the transfer school either by going to the school 

if there were a number of students identified for that school, or 

by telephone if we had fewer students listed. If that 

intermediate school had received, but later discharged the 

student, we contacted the "new" intermediate school. We 

continued this process until either we had the name of each 

student's high school or until we could no longer trace .the^ 

student. In addition, we wrote letters to parents, interviewed 

former classmabys, and questioned paraprof essional classroom 

aides who. had had children in the first two cohorts about 

students that we could not locate, thereby utilizing several 

means to locate as many students as possible. There was one wave 

of data collection for Cohort 1 because there are no computer 

recprds on those students. We had two waves of data collection 

for the Cohort 2 and 3 students because staff from the New York 

City Central JBoard of Education, in the Office of the Deputy 

# 

Chancellor for Instruction, did searches of their computer files. 
Additional Cohort 2 and 3 students were found with the computer 
search, so we did a mailing to high schools for those students' 
records. All data reported come from school records . 

Instrument . Each student's name and date of birth appeared 
on an individual form. Students were not identified on thesis 
forms as members either of the Direct Instruction Follow Through 
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group or the control g rou p. The form asked f Qr the following 
information: - . . . ■■ 

(1) high school graduation date 

(2) ninth grade reading score 

. • " (3) ninth grade math, score , • 

(4) student's appi icat i 0 n to college 

(5) student's/acceptance to college 

(6) student's special education placement 

(7) student's school attendance for the 
previous year 

Approximately tw Q weeks after the forms were mailed, we 
began to telephone and visit schools that failed to respond to 
the letter and questionnaire, ^e continued this procedure for 
approximately three months. Then, to pursue as much of the 
missing information as possible, we again telephoned or visited 
schools to gather the remaining data. 

During the visits a nd follow-up phone calls, we pressed for 
a,ll of the information Q n each student. We took particular care 
to define the term, "transferred." Occasionally, students' 
records were coded M 17+ # » This code sometim£ s acc ompanied 
"transferred," on the student record folder; We found that "17+' 

meant either the student wa£ over 17 and h^d dropped out of high 

( 

school, or it meant the student had transferred to another 
school- School personnel are understandably sens itive about the 
high percentage of inner-cfty students who drop out and fail to 
finish high school (45^50% New York Times , March 15, 1983 or up 
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to 68%, New York Times , June 10, 1983). Therefore, we took care 
to explain that we were looking for all long-term effects from an 

<. " c 

early childhood program, and that while it was important to keep 
track of dropouts, we were interested ^Ln various information on 
each student. Only if the second school contacted yielded no 
information, were students considered lost and subsequently 
dropped from the sfudy. 

Results 

Percentages graduated, retained T dropped out , applied to 
college, and accepted for college . Table 2 summarizes the 
results of this portion of the study. 

Insert Table 2 about here. 



Sixty-two percent of the Direct Instruction Cohort 1 
students, sixty-four percent of the Cohort 2 students, and sixty- 
two percent of the Cohort 3 students graduated from high school, 

whereas only 3,8% of the Cohort 1 and 2 Control students and 39% r 

* h 
of the Cohort 3 Control students graduated. A little over 4 

t \ 

percent of the Direct Instruction Cohort 1 students, fifty \ 

.' \ 
'percent of the Cohort 2 students, and 10 percent of the Cohort>^0 

students v;ere held back at least one grade. Approximately forty-/ 

two percent of the control group Cohort 1 students/ thirty-fiv^ 

percent of the Cohort 2 students, and twgjjty-one percent -tff the 1 
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^ Cohort ^3 control students repeated at least one grjide. The 
dropout rates vin*y*4)y cohort, though for the first two cohorts, 
substantially more control students than direct instruction 
students failed to complete high school. Thirty-nine, twenty, 
and twenty-four percent, respectively, of the Cohort 1, 2, and 3 
Direct Instruction students dropped out of school, whereas, 
sixty-two, fifty-eight, and eighteen percent of the control group 
students dropped out 



Half of the Direct Instruction Cohort 1 students applied to 
college, and 41 'percent were accepted; twennty-three percent of 
the Cohort 2 students applied and were accepted; and thirty-eight 
percent of the Cohort S^tudents applied and were accepted for 
college. In contrast, eighteen percent of the Cohort 1 control 
group, twenty-five percent of the Cohort 2 control group, and 
twenty-four percent of the Cohort 3 control group applied to 
college. Nine percent of the Cohort 1 control group, twenty-one 
percent of the Cohort 2 control group, and twenty-one percent of 
the Cohort 3 control group were accepted for college. - : 

The results of the t-tests for the percentages graduated, 
retained, dropped out, applied to and accepted for college, 
aggregated for Cohorts 1, 2, and 3, Direct Instruction and 
Control students appear in Table 3. All differences are 



Insert Table 3 about here. 
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significant beyond at the j> = ,01 level. Approximately sixty 

,j 

percent of the Direct Instruction students graduated from high 
school , in comparison to almost thirty-eight percent of the 
control students. About twenty-one perconc^of the Direct 
Instruction students and almost thirty-three percent of the 
control students were retained. A little unde^ twenty-eight 
percent of „ the Direct Instruction students have, dropped out of 
high school, whereas almost half (46%) of the control students 
have left school. Almost twice the percentage of Direct 
Instruction^ students have applied to college (34%) in comparison 
to eighteen afid a half percent of the controls* Exactly twice 
the percentage 4 , of Direct Instruction students were accepted for 

college (34%) as control students (17%) . * „ - 

* - - 

Ninth grade reading and math scores ., The ninth grade 

reading and math score comparisons appear in Table 4. All scores 

are reported in grade equivalents because these are tl^ only 

scores available. The; ninth grade scores are Total Reading or 

Total Math scores py the California Achievement Test. The Direct 

instruction students scored 9.6' (SD = 2.22), 8.51 (SD = 2.16), 

and 9.4 (SD = 2.24) in reading for the three cohorts. The 

control groups scored 7.59 (SD =2.54), 7.96 (SD « 1.92), and 

8.94 (_SD = 2.59) in reading for the same three cohorts. The 

\ ■ • 
aggregated reading score for the Direct Instruction students is 

9.20 ( SD = 2.22), and 8.21 (Stf = 2.42) for the control group. 

The t-tests for the Cohort 1 comparisons and for the aggregated 
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comparisons are significant at the £ » .01 level. Cohort 1 
Direct Instruction student's averaged 8.3 (SD - 2.13) in math, s 
Cohort 2, 8.08 (SD =.2.52), and cohort 3, 9.03 (SD 2.35). The 
control students averaged 7.79 (SD - 2.67) for Cohort 1, 7.60 (SD, 
= 1.79) for Cohort 2, and 8.33 SD = 2.2^) for Cohort 3 in math. 
The aggregate of the three cohorts shows the Direct Instruction 
groups averaging 8.59 ( SD = 2.33)\jand the control students 7.95 
(SD = 2.23) in math. 



Insert Table 4 about here. 



Correlations of third grade reading an ^ rpath scores with 
ninth grade s^pres . End of third grade reading and math scores 

were available only for the Direct Instruction students. We 

k. 

calculated Pearson Product Moment correlations for third grade 
Wide Range Achievement Test (the WRAT) Reading and Math; Slosson 
IQ; and Metropolitan Achievement Test (the MAT) reading scores 
with ninth grade reading and math scores for Follow Through 
.j graduates. These correlations appear in Table 5. 



Insert Table 5 about here. 

■ / 



There are generally high correlations for MAT and. WRAT end - 
of -third grade reading scores and ninth grade reading . Third, 
grade MAT total reading scores and. ninth grade total reading 
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scores correlate .78 for CoTi^rt 2 and .81 for Cohort 3. The fcnd- 

of-third grade WRAT Reading scores and 9th grade reading scores 

f ' 
Correlate .47 for Cohort 1,, .71 for Cohort 2, and .73 for Cohort 

3. End-of-third grade WRAT math scores correlated with |(fchj grade 

math scores .49 for Cohort L, and .39 for Cohorts 2 and 3. 

* 

Slosson IQ scores were available \only for Cohorts 1 and 2. 

if* . 

Correlations* of 9th grade reading scores with Slosson IQ scores 
were .37 foil Cohort 1 and .49 for Cotj&rt 2. Ninth grade math 
scores and Slosson IQ scores correlated .20 for Cohort 1, and .49 
for Cohort 2. ' 

To determine the equivalence oJE the sample of students found 
in this longitudinal study to the entire group of Direct 
Instruction students completing third grade, we 'calculated the 
sample's end-of-third grade reading performance and compared it v 
to the data available on the entire cohort's reading performance 
and to the performance of poor students only in# each cohort. The 
average performance of each cohort found was lower at the ^nd of 

third grade in reading and math on the WRAT and the MAT than the 

* 

average performance of either the total cohort or the poor 
children only subsample of the cohort. 

We seldom received information requested for Special 
Education placement and attendance. Therefore,, those data are 
not reported. 
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Discussion 



In this part of the paper, I will discuss the results' of 

this longitudinal study of Direct Instruction Follow "Through 

students in terras of: (1) the Cohort 1 and 2 and 3 students that 

we traced successfully through high school; (2) the percentages 

of graduates, retainees, dropouts, college applicants; and 

college acceptances; (3) a comparison of ninth grade reading and 

math scores for Follow Through graduates and the control , 

students; and (4) correlations of the end-of-third grade and 

ninth grade norm-referenced scores for Follow Through graduates. 

the 'final segment of this paper will present the implications of 

this study and suggestions for future research. 

We found 82% of the Direct Instruction Cohort 1, 2, and 3 

students. I,n comparison, we found 76% of the control students. 

While some might ask if we found students who lare representative 

\ . . 

of both groups, we can argue that if anything, our sample of 

Direct Instruction students performed slightly lower at the end 

of .third grade than the entire group of Direct Instruction Follow 

Through students performed at that time. Also, the 

identification process was the same for P.S. 137 and the control 

school when we developed the cohort rosters. Our data retrieval 

process was such that no one involved in collecting data could 

identify students by early childhood program, thereby biasing the 

results by pursuing some students more vigorously than others. 

y t ■ ; 

The 16% attrition rate is actually quite low for a district whose 
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school rosters turn over on an average of 40% e/tch year. It is 
safe to assume, therefore, that we found similar students from 
both P.S. 137 and the control school, though tt\ese may be the 
most stable ^tudents from both schools. 

Percentage of Graduates, Retainees, Dropouts, College 
Applicants, College Acceptances, and Graduates . In all cohorts, 
over half of the Direct InstWc^ion^J^ll^ Th^pctgh graduates 
finished high school as compared to just .over a third of the 

control group students'.. These are statistically significant 

j 

differences that point rather clearly to apparent later effects 
from the Direct Instruction Follow Through program. Children 
from Direct Instruction Follow Through graduate from high school 
at a higher rate than students from the control school, although 
a slightly higher percentage of Direct Instruction Cohort 3 - 
students dropped^ out of high school. 

Some of the differences in graduation rates may be 
attributed to the higher percentages of Puerto Rican students in 
the control schoolTPVsr 137 averaged 11% Puerto Ricari students 
while the control school averaged 17% Puerto Rican students). 
Dropout rates are highest in New Yc^rk^City for Hispanic students 
with 36% of those 18-19 year old students dropping out ( New York 
Times , June 20, 1982). Forty-six percent that dropped out from 
the Cohort 1, 2, and 3 % control groups is still much lower than 
the national figure of 73% Hispanic dropouts in the United States 
as *a whole (Grant & Eiden, 1982). Thus, the District 23 students 
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from both ^elementary schools are graduating at higher than 
expected national averages for their ethnic groups, 

Retainees , A little over 4% (4.3%) of the Direct 
Instruction Cohort 1 students and 42% of the control group were 
held back. Cohort 2 percentages are appreciably higher for both 
groups. We can document that the principal at P.S. 137 held over 
all students not at grade level in reading in the early 1970' s. 
This would explain at least some of the jump from 4.3% to 50% of 
the Direct Instruction students retained. We have no comparable 
explanation for the drop from 42% to 35% of the control group 
students retained from these two Cohorts. Both groups have fewer 
students dropping out from Cohort 3, 10% Direct Instruction, and 
21^ controls, though these percentages may increase if some 
students "who are still in school from Cohort 3 fail to graduate 
this year; , 

The inconsistency of the retention percentages and 

' / i 4 

subsequently, the very low percentages of students from those 

Cohorts dropping out of high school support the Consortium 

(Lazar, et al., 1977) findings for one-- of its fourteen treatments 

where the program holding back almost 50% of its students , later 

had the lowest percentage of students placed into Special 

Education classes, The findings from this study also suggest 

that' retaining lower-performing students in the early grades may 

help them to succeed in the later grades. 
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Dropouts . It is impossible to lbok at the percentages of 
students graduating from high school' without looking 
simultaneously,' of coujrse, at the percentages of students 
dropping out of high^jS£hool belfore graduation, though some 
"students in this study 'are still in school. The Direct 
Instruction Follow Through graduates dropped out significantly 
less than the control students from Cohorts 1 and 2.- While some 
could argue that. the difference in the percentage of Hispanic 
students at P.S. 137 and the control school clouds the dropout 
effects" for these groups, there are such clear differences 
favoring the. Direct Instruction 'Cohort 1 and 2 students that it 
is very likely that program effects account for significant 
amounts of the difference. Despite the higher percentage of 
Direct Instruction Cohort 3 students dropping out (24% to 18%), 
when aggregating, the 3 cohorts, 22.9% variance for dropouts is 

r * ' 

accounted f</r by treatment. 

College applicants . The percentages applying to and being 
accepted for college present another comparison of the two 
groups. While there are clear effects for the Direct instruction 
Cohort 1 and Cohort 3 students, the're gx^ no such effects for t\\e 
Cohort 2 groups. When aggregating the three cohorts for each 
group, 53% of the variance for college application is accounted^ 
for by treatment. Likewise, 58.8% of the variance for college 
acceptance is accounted for by treatment, f 
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If we look across the five general measures of high school 
success in this study, the pattern of effects for all three 
cohorts clearly support; t:.e Direct . Instruction Follow Through 
graduates. The Direct InF -uction students perform significantly 
better on twelve of the ren measures when we test each cohort 
separately. When we" aggn ai the three cohorts, Direct 
Instruction students perform significantly better than their V 
controls on all five measures. Higher percentages of those 
students graduated from high school, fewer dropped out of high' 
school, more applied. and were accepted for college. Equally 
interesting, but less strong are the comparisons of ninth grade 
reading and mth scores a nd the correlations of third grade and 
ninth grade reading and math scores reported next. 

Ninth grade reading comparisons . There are significant 
differences in ninth grade reading for Cohort 1 students and less 
strong, though consistently positive effects favoring the Direct 
Instruction students in all 3 cohorts for reading and math. It 
is possible that the implementation of Distar Reading III— 
(Engelmann & Stearns, 1972) which was in a field tryout edition 
for the Cohort 1 and 2 students accounts for £ome of the high 
reading performance for these students. The Distar Reading III 
materials rely extensively upon expositety passages written for 
the program from which the students learn a number q£ scientific 
rules about the three forms of matter, jtnomentum, and pkeletal 
system, to name just a few. There is now substantial research 
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(Durkin 1978-1979; Durkin, 1>980; Mason, 1983) to document that 
there is very little narrative $v expository reading 
comprehension instruction in traditional classrooms. It is 
possible, therefore, that the combined effects of the lack of 
reading comprehensian instruction for the control groups and the 

heavy emphasis on re3dinjf expository text in Distar Reading III 

/ 

for the. Direct instruction students contributed these 
dif f erences It is also likely that the Distar Language 
instructiqn that paralled the students' reading instruction but 
focused on oral problem solving and other skills contributed 
Soundly' to this long-term reading performance. 

Ninth grade math comparisons! The math differences also 
favor the Direct Instruction groups for all cohorts. There is a 
,5-morith difference in performance for Cohort 1 students, about a 
4-month difference for Cohort 2 students, and an almost 7-month 
difference for Cohort '3 students. It is popssible that math 
performance in ninth grade is more dependent upon math 
ins truct ion beyond third grade than is reading instruction. 
Although Direct Instruction students outperform their control 
groups in math, they are still* about half a year below grade 
level in ninth grade. This performance suggests that both groups 
would benefit from additional math instruction. The ninth grade 
comparisons in reading and math differ somewhat from the results 
for Direct Instruction graduates in fifth and sixth grade 
reported earlier by Becker and Gersten (1982). The Becker and 
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Gersten work showed consistent strong effects for WRAT reading 
and math problem solving and spelling, but only moderate effects 
in Total Reading and Total Math on the Metropolitan Achievement 
Test. The Becker and Gersten results for MAT Total Reading and 
Total Math and Science show lesser effects than the results of 
this study. Apparently, there are stronger long-term effects in 
Total Reading in ninth grade than there are in fifth or sixth 
grade. There are three possible explanations for the difference 
in these results. First, continuous effects in Total Reading may 
favor four-year Direct Instruction implementations — those sites 
where the program begins in kindergarten and continues through 
third grade. The Becker and Gersten (1982) study is limited to 
first grade starting sites. The extra year of treatment could 
account for the difference. Second, P.S. 137 and this control 
group are more disadvantaged than the sites studied by Becker and 
Gersten (1982). Perhaps the Direct Instruction program's most 
potent effects are in the most disadvantaged communities—those 
communities where schools have the greatest impact. The third 
po*^ible explanation is that the Direct Instruction effects 

are less pronounced in the middle grades but then rebound 
in early high school and strengthen through, high school to cause 
greater end of high school differences. One could test all three 
of these hypotheses by replicating this longitudinal study in a 
variety of setting. 
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Third grade to ninth grade correlations . The Direct 
Instruction groups were the only groups for which we could 
correlate a variety of end-of-third-grade scores to ninth grade 
reading and math scores. No comparable data were available for 
the control groups because individual student test ..ores are 
archived in New York City after ten years. It is most 
interesting to note that there ape^ very high correlations (_r 
~ .78 and jr = .81) between the spring third grade Metropolitan 
Achievement Test (the MAT) scores and the ninth grade Total 
Reading scores. This correlation is even higher than the 
correlation suggested by Bloom (1976) when h§ predicted that 
third grade and ninth grade standardized test scores would 
'correlate +.75. This means that the end-of-third-grade MAT Total 
Reading score is a very good predictor of ninth grade reading 
success. Students who do well on the MAT at the end of third 
grade are highly likely to do well in ninth grade. 

In comparison, the Wide Range Achievement Test (WRAT) third 
grade scores in reading and math correlate highly in reading (jr 
= -47, jr =. .71, and £ - .73) with ninth grade scores. These high 
correlations show the WRAT, too, to predict from moderately to 
very well from the end of third grade to ninth grade reading. 
The WRAT math test correlates moderately (j: = .49 and jr = .39) to 
ninth grade math scores, showing a positive relationship, though 
not an extremely high correlation. 
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Correlations of IQ and ninth * grade scores . The Direct 
Instruction model administered the Slosson IQ test as a measure 
of language ability. The correlations are moderate for the 
Slosson on 9th grade scores for Cohort 1 and 2 (_r = .37 reading, 
and £ = .49 math; _r = .20 reading and _r = .49 math) . This 
suggests simply that for whatever reason, IQ correlated more 
highly for Cohdirt 2 students in reading and math than it did for 
y^ohort 1 students. The implementation of the Direct Instruction 
Model at P.S. 137 was equally strong for the Cohort 1 and 2 
students, so there is no readily explainable difference in the 
correlations for these, cohorts . 

Implications and a suggestion Cfor future research conclude 
this paper . / ■ 

Implications ■ • 

When one begins an intervention, one hopes for lasting 
change, particularly when intervening in an area that has the 
potential to effect subjects 1 lives. We must believe that' some 
of the impetus for funding programs for the poor, such as Follow 
Through, as part of the War on Poverty stemmed from the. desire to 
make life better on a short-term and long-term basis for 
disadvantaged minority people in the United States. In the late 
1960 f s, federal support went to poor families and schools in the 
hope that increased funding and innovative programs would result 
in increased educational achievement and lifetime opportunities. 
This study has demonstrated that there are apparent long-term 
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effects of the Direct Instruction Follow Through program at P.S. 
137, There are five major implications from this wofk. 

First, these results are important in light of the criticism 
often leveled at the Distar Reading I and other synthetic phonics 
beginning reading programs. Critics of these approaches suggest 
that a reading progtam with an early emphasis on decoding will 
produce "word callers"" students who decode words skillfully 
without comprehending what they read. Critics also contend that 
if students are first taught synthetic phonics, they may actually 
be hin lered in the later grades when there is greater emphasis on 
comprehension. The data from this study suggest the contrary. 
The third grade and ninth grade tests are primarily tests of 
reading comprehension, not decoding. It appears^that^he Direct 
Instruction students are indeed comprehending what they read. 
The children who did well at the end ofrthird grade are the same 
children who do well in ninth grade. 

Second, there is recent evidence ( New York Times, May 15, 
1983) that minority students are dr.opping out of high school at 
rates higher than they were even three years ago. This problem 
is particularly grave in the inner cities. In New York City, for 
example, 45% of the students who enter ninth grade will drop out. 
A number of high school programs designed to interest students in 
staying in school have failed, and the focus is how returning, 
"to programs to raise student achievement long before the 
students get to high school" (Halverson, 1983) , The results of 
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this longitudinal study strongly suggest that the roots of long- 
term success may well li£ in an academic early childhood program • 
The die is cast by the en3 of third grade. 

Third, the controversial Gates Program in New York (see 
Minter, 1982" for a description), or similar programs such as 

Mastery Learning in Chicago that emphasize' student achievement of 

J> - 

basic skills in the early grades and retaining students who fail 
to achieve mastery may well be on the right track* These 
programs operate on the philosophy that children should be close 
to grade level in the early grades and should not be allowed to 
•move through school without achieving mastery. The findings from 
this study and the Lazar et al . (1977) work support early 
retention in mastery-based programs»and suggest that perhaps it 
is particularly important to have students performing well by the 
end of third grade • 

Fourth, regular elementary school programs can interpret 
these results to suggest that strong kindergarten through third 
grade programs with ^n academic focus on reading, language, arid 
math with mastery may bolster disadvantaged students' chances for 

greater long-term academic success.* In these days of decreased 

i 

funds for education, studies guch as this that strongly suggest 
that early interventions can havje lasting effects should be 
considered seriously by policy-miakers with smaller budgets and 
larger numbers of poor students. These results point to j 
increased benefits for poor children who receive help in basic 
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skills when they enter school. Early intervention -may be the 
most cost effective educational program on a long-term basis. 

Fifth, the results of this study suggest that longitudinal 
research in education is important and worth the trouble. Only 
after collecting and analyzing these kinds of data can 
administrators, school board members, educators, researchers, and 
parents develop a sense of the importance and the effects of an 
academic early childhood education. 

In their book, Early Schooling: Cognitive and Affective 
Outcomes, Entwisle and Hayduk (1982) suggest, "First, the early 
grades may be precisely the time that schools have their/7 
strongest eff ects .. .elementary schools tend to mirror the 
neighborhoods they serve. For this reason, school and home 
influences are probably most congruent at this life stage," '(p. 
136). Few would argue that in this country elementary schools 
tend to mirror their neighborhoods, and this study demonstrates 
that Entwisle and Hayduk may be correct that the early grades may 
be the time that schools have their strongest eff ects . The P.S. 
137 students and the control students come from very similar 
neighborhoods, but they now have very~3if f erent life chances. 
These groups received very different early childhood programs, 
and there have been significant long-term differences in the 
program's effects. • 
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Footnote 

Project Follow through was conceived by Federal 
government in the mid 1960^ as part of the War on Poverty* 
Twenty sponsors, early childhood university groups or educational 
labs, tested their programs throughout the United States. All 
approaches were comprehensive in that they had parent, health 
service , and educational components • The Direct Instruction 
Model implemented at P.S. 137 had a strong academic focus on 
basic skills for kindergarten through third grade, 
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